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BIOLOGY AND NONEQUILIBRIUM: 
REMARKS ON A PAPER BY J.L. ENGLAND. 


by David Ruellef. 


Abstract: 

This note analyzes the physical basis of J.R. England’s paper 
“Statistical physics of self-replication.” [J. Ghem. Phys. 139, 
121923(2013)]. We follow England’s nse of time-reversal sym¬ 
metry bnt replace stochastic by deterministic dynamics, and in- 
trodnce a dehnition of metastable states based on equilibrium 
statistical mechanics. We rederive England’s detailed balance 
relation and obtain another similar relation which appears more 
natural and remains valid for quantum systems. The detailed 
balance relations are based on serious physical ideas, and either 
of them can be used for England’s biological discussion. This 
biological discussion does of course deserve further scrutiny. 
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1. Introduction. 


A recent paper by J.L. England [3] nses non-eqnilibrinm statistical mechanics to pre¬ 
dict thermodynamic limitations for biological replication processes. The conceptnal strnc- 
tnre of England’s paper is snch that it permits a serions analysis based on credible physical 
principles. In this note we go throngh a discnssion of snch physical principles, bnt nnlike 
[3] we shall not nse stochastic dynamics. We shall aim at being more general (allowing 
qnantnm mechanics) and more specihc in the conditions of applicability. [Papers related 
to [3] are [ 6 ] and [7], bnt I prefer the clean conceptnal strnctnre of [3]]. To state things 
briefly we shall obtain a variant (3) of England’s relation (1) below, eqnivalent for biolog¬ 
ical applications bnt valid also for qnantnm systems. The derivation of the relation (3) 
shonld make it clear that it is based on general physical principles, and free from ad hoc 
assnmptions. 

England’s analysis starts with a general detailed balance relation (1) for a system M 
in contact with a bath at inverse temperatnre (3. One considers the conditional probability 
7 r(/ II) that the system M is initially in the macrostate I and goes after time r into 
a macrostate II. The reverse probability is 7 r(// I). In one intended application, I 

describes a one-bacterinm state which, after cell division, goes over into a state II with 
two bacteria. As to the bath it consists of water at inverse temperatnre /?, with some hxed 
pressnre, containing nntrients, etc. The detailed balance relation (eqnation ( 8 ) in [3]) is 


(3{AQ)i^ii + In 


[7r(//-> /)] 
.7r(/-^ //)- 


+ ASint A 0 


( 1 ) 


where AQ is the amonnt of heat released into the bath and ASint is the increase in 
internal entropy of M. The meaning of the asymmetric average (■ ■ ■)i^n will be discnssed 
in Sections 4. and 5. below. 

The application of (1) to biological replication ass um es an exponentially growing nnm- 
ber of replicators: n{t) — n( 0 ) exp(( 5 f — d)t) where (7 is a rate of generation and d a decay 
rate. The formation of a new replicator changes the internal entropy of the system of 
replicators by Asint while pntting an amonnt Aq of heat into the bath. From (1) one 
obtains the relation (eqnation (10) in [3]): 


Astot = 13Aq + Asint > 


( 2 ) 


Note that g and 5 appear here as the ratio g/5. 

From (2) varions conseqnences for the efficiency of replication are derived [the repli¬ 
cator that dissipates more heat has the potential to grow faster, etc.]. For a discnssion of 
these conseqnences we mnst refer to [3]. 

Onr stndy of (1) in the present paper will follow [3], bnt nse deterministic rather than 
stochastic dynamics. We shall describe macrostates as nnions of metastable states dehned 
according to the principles of eqnilibrinm statistical mechanics. As in [3] detailed balance 
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will be based on time reversal symmetry of the basic evolution equations. We shall recover 
(1) in the deterministic case, but also derive another result: 


/3(Ag) + In 


r7r*(//^ /)i 
- 7r(/ -> II) . 


+ ^Sint A 0 


( 3 ) 


where (■ ■ ■) is a natural symmetric average obtained from our description of metastable 
states and 7r*(// I) is an estimate of the probability of II I. [Using the probability 
7r{II I) of the exact time reversed process of I ^ II would give equality in (3)]. We 
assume here that /—)■// is an observed process, usually irreversible, so that the exact 
time-reversed process //—)■/ is physically unobservable. Very crude estimates 7r*(// —)■ I) 
of 7r(// —)■ I) are obtained in [3] based on realistic processes. These very crude estimates 
from above turn out to be useful because 7r*(// I) occurs in (3) through its logarithm. 

The proof of (3) extends naturally to quantum systems (see Section 7) while the proof 
of (1) in [3] does not, due to the use of stochastic dynamics, and the fact that (■ ■ ■)i^n 
has no quantum equivalent. Note that we are still far from a rigorous treatment of (1) or 
(3) but the use of deterministic dynamics and of a precise dehnition of metastable states 
permit a clearer understanding of the limitations of the arguments used. 

The relation (3) can be used instead of (1) to derive (2) and justify the biological 
discussion in [3]. Furthermore, (3) has the advantage of holding also for quantum systems, 
and permits perhaps a more precise assessment of the applicability of (2). 


2. Preliminaries. 

In his discussion of the detailed balance relation (1), England refers to G.E. Crooks [1] 
who uses classical mechanics to describe the system M of interest and stochastic dynamics 
for the bath. The use of stochastic dynamics (Langevin’s equation) is traditional and 
has proved very useful in nonequilibrium statistical mechanics (see for instance [2]), but 
it limits the understanding of what is physically going on (see [4], [9] for more modern 
views). We prefer thus an approach based on deterministic dynamics. Our discussion will 
be mainly classical but we shall indicate how to extend it to quantum systems (Section 7). 
Indeed, the questions considered here involve chemistry, for which quantum mechanics is 
important. 

The problems discussed in this note pertain to nonequillibrium statistical mechanics. 
While there is a serviceable theory of nonequilibrium close to equilibrium (see [2]), it does 
not apply here because the life processes we are interested in are far from equilibrium. 
Note in particular that (1) involves entropy, and there is no general useful dehnition of 
entropy far from equilibrium (see for instance [5] and [10] for a discussion of this question). 
Here we are saved by two facts: 

(El) Description of metastable states. 

Entropy and other thermodynamic variables can be dehned for metastable chemical 
systems. The dehnition is imprecise but the imprecision is small for long-lived metastable 
states (think of diamond or a O 2 + 2 7^2 mixture at room temperature and pressure). 
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Metastable states can be described by equilibrium statistical mechanics: take the usual 
ensembles and restrict them to a dynamically almost isolated region of phase space. 

(F2) Time reversal and detailed balance. 

The dynamics of the transition /—)■// from a macrostate / to a macrostate II may 
be very difficult to analyze. But if the dynamics is given by a time-reversal symmetric 
Hamiltonian, we have control over the specihc quantity 7r(// —)■ I)/ti{I —)■ II) where 
7r(/ —)■ II) is the probability of the transition I II after time r, and 7r(// I) is the 
probability of the reverse transition (this is detailed balance). 

Our discussion below will be based on (FI), (F2), and we also assume: 

(F3) Short equilibration times for the metastable components of /, II. 

The equilibration times (thermalization, etc.) for the metastable components off and 
II should be short compared with the transition time r. 

We are interested in a system M in a bath. We shall hrst think of M as a single 
molecule which can be in a metastable state / or //. Then we shall consider more general 
situations where M is for instance a bacterium or two bacteria. It is physically desirable 
to surround M by a region V and to let a variable X describe the positions and velocities 
of M and the bath molecules inside of V. 

For simplicity we assume short-range forces and choose a region IF D H such that 
the inside of V doesn’t interact with the outside of IF. We let Y describe the position of 
molecules in IF\H. 

Suppose that the bath occupies a large region containing IF. Because the bath is 
large, the effect of changes inside IF (such as the release of heat) dissipates rapidly, leaving 
the region IF\H essentially unaffected. 

[Unfortunately, the choice of the small regions U, IF in a large bath cannot be done 
neatly in the quantum case due to noncommutativity]. 



X describes V 

Y describes W\V 


3. Estimating the ratio ti{II I)/ti{I II) when M is a single molecule. 
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Let P be the phase space describing a body of H 2 O (bath) in a large container, pins 
a molecnle M hxed or restrained in the middle of the container. If we £x the energy E 
for a snitable Hamiltonian H{Q) we see that the volnme element — E) dfl in P is 

preserved by the Hamiltonian time evolntion [we may assnme that the volnme element is 
ergodic, if not choose a large ergodic component]. We remark that d{H{Q) — E) dQ is after 
normalization the microcanonical ensemble of eqnilibrinm statistical mechanics, for which 
we shall nse the notation dO. We snppose here that H{Q) has the nsnal form of kinetic 
pins potential energy and is thns invariant nnder time reversal (replacing the moment um 
P by -p). 

As described earlier we snrronnd the molecule M by a set V and a larger set W. We ob¬ 
tain a statistical description of what is inside V (the molecule M and some water molecules) 
by integrating over the degrees of freedom outside V. For this it is desirable to replace 
the above microcanonical ensemble by the canonical ensemble Z~^ exp(—/3iL(0)) dO for a 
suitable inverse temperature (3. The fact that the microcanonical and the canonical ensem¬ 
bles yield the same results inside V in the limit of a large bath is physically reasonable but 
we shall not try to prove it [it would fall in the category of results known as equivalence of 
ensembles, see [8]]. It is desirable to use the microcanonical ensemble dO when discussing 
time-reversal symmetry, and the canonical ensemble when discussing the system inside V. 
When we use the classical canonical ensemble it is convenient to ignore momenta (which 
play a trivial role) and to replace the phase space (positions and momenta) by the con- 
hguration space (positions only). If X describes a point of the conhguration space inside 

V and Y the conhguration in W\V, the conhguration (or potential) energy corresponding 
to X is of the form U{X\Y) because the molecules outside of W do not interact with 
those in V. Using the canonical ensemble we hnd that the probability distribution over 
the conhgurations inside V is of the form 

[j dYZ-^exp{-pU{X\Y))]dX with Zy = J exp{-pU{X\Y))dX (4) 

where we have integrated over all positions outside V, keeping only the integration over 

Y explicit. As indicated above we believe that we would obtain the same distribution (4) 
in the limit of a large bath if we started with the microcanonical ensemble. We may also 
assume that the probability measure for Y denoted here by dY is unique in the limit of 
a large bath. [We may include a factor corresponding to an integral over moment um in 
the dehnition of dX so that dX is a phase space rather than conhguration space volume 
element: this will be useful later when we discuss entropy]. 

The macrostates I, II of the molecule M are here single metastable states I, II cor¬ 
responding to subsets P^, P^^ of the phase space P [with total energy hxed at E if we use 
the microcanonical ensemble]. Metastability means that the sets P^,P^^ are dynamically 
almost isolated from the rest of phase space. We assume that P^ and P^^ correspond to 
sets Ry and Ry of conhgurations X describing the molecule M and the inside of V [the 
parameter Y corresponds to a conhguration in IU\U]. Note that there is some imprecision 
in the dehnition of Ry and Ry since the point O describing a metastable state may escape 
from P^ or P^R The relation assumed between P^,P^^ and Ry,Ry implies the time- 
reversal invariance of P^,P^R If Oy^Oy denote the characteristic functions of Ry^Ry, 


5 



we may use (4) to describe the metastable state / as a probability measure (depending on 
Y) with respect to the variable X: 


{Zi.)-^ei^{X)exp{-pU{X\Y))dX with = / exp{-pU{X\Y))dX 


and similarly for the metastable II. 

We consider now a possible rearrangement of the molecule M so that it goes from 
the metastable state I to the metastable state II in time r. This means that under the 
Hamiltonian dynamics (/*) a fraction of the points in have ended in after time r. 
We assume that the dynamics in P^^ is rapidly mixing so that f^P^ restricted to P^^ is 
evenly spread over P^^ with some coarse-grained density A. [This is the meaning of our 
assumption (F3) that the equilibration time of II is short with respect to the transition 
time T. We have A = 1 for a reversible process while A < 1 for an irreversible process.] 
The probabilities of the transitions I —)■ II, II —)■ / after time r are thus (using the 
microcanonical volume element dO) 


7t{I^ II) 



7r(// ^I)^ j 


where 


I dO/ / dO 

piinf-^pi / Jpii 


/ dO= / dO= / dO 

Jp^^nf^p^ Jp^nf—^p^^ 


[the assumed invariance of dO and P^, P^^ under time-reversal symmetry give the hrst 
equality, the (/*)-invariance of dO gives the second]. Therefore 


7r{II ^ I)/tt{I ^ II) = / do// dO 

Jpi / Jpii 

4. Proof of (1) for general M. 

In this section we discuss a situation where M is more general than a single molecule: 
its macrostates I and II could be a bacterium or two bacteria. At the same time we replace 
the bath of II 2 O by a bath containing nutrients, etc. These changes are mostly harmless 
from our point of view and do not even force us to change notation. One point however 
requires discussion: in the case of a single molecule M we assumed that the macrostates / 
and II are metastable states and that the time r associated with the transition between / 
and II is long with respect to the equilibration times in the states I and II. In more general 
situations this assumption is not acceptable. For instance if / is a state of a bacterium 
with a hxed number of protein molecules, this need no longer be true in state II. We 
will therefore accept the fact that the macrostates / and II are collections of metastable 
substates li and IIj satisfying (F3). 
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We may write = VJjP^^\ but it is readily seen that the formulas 

written above for 7r(/ —)■ //),7r(// —)■ /), and 7r(// —)■ —)■ //) remain valid (use 

time-reversal symmetry). We can now proceed to prove (1). 


We have 



Zy^dY [ exp{-pU{X^\Y))dX^ 
JR{. 


j Z-^dY\Riy 


-1 



exp (In \Ry 


(3U{X^\Y))dX^ 


where \Ry\ = fj^i dX^. Using similar notation for the macrostate II, and the identity 
\Ry 1“^ dX^^ = 1 we hnd 


\Ry\~^ j exp(ln|P(.|-/3U(W^|y))dW^ 

Jr{. 


= \R 


ii\-i 
Y \ 


exp(ln |P(/1 - /3U(W \Y))dX 


II \ 


'rR 


'II 


xlRi']-^ I exp(ln|P(.|-ln|P(/|-/3(U(W^|y)-U(W^^|y))dW 




Therefore 


where 


[ dft / [ dO = {F)ii 

Jpi / Jpii 


{F)ii= f ZR^dY\Ri/\-^ f exp{ln\RiJ\- pU{X^^\Y))dX^^ F{Y,X^^) 

J J FtlJ 

j I ZR^dYlRi'^]-^ J exp(ln\R{^\-pU{X^^\Y))dX^^ 

F{Y,X^^) = \Ri'\-^ [ expilnlRi-l -hi\Ri'^\ - P{H{X^\Y) - U{X^^\Y))dX^ 


JR{. 

= { exp(ln |P(.| - In 1 - /3{H{-\Y) - U{X^^\Y)))j 

Note that there is no symmetry between (...)/ and (...)//: see Remark 5 below for a 
discussion of this point. 

We use the notation {■ ■ ■)i^n = {{■ ■ ■)i)ii and the convexity of exp to obtain 
TI{II -> I)/ti{I -> II) = {F)n = { exp(ln \rU - In |P(/1 - 
> exp(ln |P(.| - In |P(/| - = exp{-ASir,t - /3{AQ)i^ii) 
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where the change in internal entropy is 


[remember that Ry is a volnme in phase space] and the energy given to the bath is 

AQ = U{X^\Y) - U{X^^\Y) 

We have essentially recovered a proof of (1), apart from an integration over dY not present 
in [3]. Remember that the condition (F3) is an essential ingredient of onr proof. 

5. Remark: asymmetry of (1). 

The qnantity 7r(// —)■ —)■ II) is changed to its inverse when / and II are 

interchanged. In the expression 

(exp(ln|Ry| - In \Ry\ - jlAQ)) 

this symmetry is preserved bnt hidden becanse (■ ■ is not symmetric. After nsing 

the convexity of exp we obtain 

> exp(ln \Ry\ — In {Ry \ — jlAQ) 

where the symmetry is broken. The symmetry is also broken in (1): this is why we have 
> 0 instead of = 0. The physical meaning of introdncing an asymmetry between I an II 
by nsing (■ ■ ■)i^n is not clear to the present anthor [this applies to the derivation in [3] 
as well as the one given here]. 


6. Proof of (3). 


Omitting a snperscript I or II, let again Oy be the characteristic f un ction of Ry and 


write 


p{X,Y) = ^ I j e-^^^^\^UXdY 


S = 



' - py{X)\npy{X)]dX dY 



= ln I I dY + /3U{X\Y)py{X)dXdY 

I Ry 



We have thns 


In 


7t{II I) 
l7l{I 11)1 


= In 



-In 


fib 





rr 


= S^ -13 U{X\Y)[pi.{X) - piJ]dXdY = -AS.nt - /3{AQ) 
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with natural symmetric definitions. 

Instead of an inequality obtained via the asymmetric (■ • ■)/->.// and (the somewhat 
artificial) use of the convexity of the exponential, we have here an equality. Note however 
that Ti{II —)■ I) is the probability of the inverse of a usually “irreversible” process (this 
inverse process is therefore somewhat unrealistic). What is done in [3] is to obtain estimates 
71*(II —)■/)> 7r(// —)■ I) in terms of realistic processes (like rate of degradation of nucleic 
acids). We obtain thus (3) finally in the form 


In 


\7r*{II /)] 

- 7i{I -> II) . 


>-AS,r,t-P{AQ) 


As mentioned earlier even a very crude estimate 7r*(// —)■ /) yields interesting results 
because 7r*(// I) occurs as its logarithm in (3). 


7. Quantum systems. 

Consider a quantum system with Hamiltonian H acting on the Hilbert space Ti, and 
let be projections in P. We assume that H and P^^ are invariant under time 

reversal and that P^^ are almost invariant under time evolution. 

The microcanonical ensemble for the energy E corresponds here to the eigenfunctions 
•0 of P such that P'0 ks P'0. We let Pe be the projection on the space spanned by these 
eigenfunctions. We have now 

7r(/ ^ II) = Tr(PE(P^e*^^P^^)(P^^e“*^-^P^))/Tr(PEP^O 

Ti{II ^ I) = Tr(Ps(P^^e*^^PO(P^e“^^^P^^))/Tr(PEPO 
Writing Pj^ = PeP^, Pe = PeP^^ we find 

Tr((Pie-^P#)(Pi^e—^Pi)) = W((Pi^e—^Pi)(Pie-^PiO) 

= Tr((Pi^e-^Pi)(Pie—^Pi^)) 
where we have used time-reversal symmetry. Therefore 

7r(// -> I)/ti{I II) = Tr(PEPO/Tr(PsP^^) 

We have metastable states localized in some sense in a small region V of the bath and 
we may replace the microcanonical ensemble by a (grand) canonical ensemble as explained 
in the classical case. We obtain 

7r(II I)/7r(I II) = Tr(e-^^P^)/Tr(e-^^P^^) 

[Due to noncommutativity we cannot here strictly restrict our attention to small regions 
V, W as in the classical case]. Omitting the superscript I or II we write 

p = e-^^P/Tr(e“^^P) , ^ = -Trp In p 
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then 


S = \n Tr(e-^^P) + (3 TxpH 


Therefore 


In 


[7r(//^ /)] 

.Tl{I ^ II). 


+(3 Tt{p^H - p^^H) = -AS - /3{AQ) 


from which the qnantnm version of (3) follows. We leave the details to the reader. 


8. Loose ends and final remarks. 

Life is fneled by chemical energy bnt also by photosynthesis. We can deal with the 
latter by saying that it creates high energy metastable states and that the rest is chemistry. 
At the level of generality of the present discnssion it seems that there is not mnch more 
that can be said. 

We have presented life processes in onr discnssion as a snccession of jnmps between 
qnasi-eqnilibrinm metastable states with relaxation to metastability between the jnmps. 
Bnt note that in onr derivation of detailed balance relations no precise description of what 
happens between states / and II is nsed: we only need a rongh description of / and II 
and a rongh estimate ln7r*(// —)■/)> ln7r(// —)■ I). For this rongh estimate the states 
I and II may indifferently be dead or living bacteria: no snbtle difference between the 
entropy of a living and a dead bacterinm plays any role here. 

Let ns discnss once more the relation between time-reversal symmetry and irreversibil¬ 
ity. The time-reversal symmetry nsed in proving (1) or (3) holds for the Hamiltonian time 
evolntion on the energy shell (i.e., the microcanonical ensemble, which we take to be er- 
godic). Introdncing stochastic forces as in [3] or replacing the microcanonical ensemble 
by another ensemble complicates the time reversal symmetry and the estimation of the 
very small probabilities Ilj^Ii. If we assnme that the process I ^ II is “irreversible” 
this implies that the time-reversed dynamics is very nnstable so that 7r(// —)■ I) is hard to 
estimate precisely. One nses instead a bigger probability 7t*{II I) based on observable 
processes. 

From a conceptnal viewpoint the paper of England, as rediscnssed in the present 
note, is based on general thermodynamics (inclnding distinction between reversible and 
irreversible processes, Carnot cycles, etc.). These thermodynamic ideas are complemented 
by ideas of Hamiltonian dynamics (time-reversal symmetry) and of eqnilibrinm statistical 
mechanics (metastable states and relation between entropy and probabilities). The well- 
known relation between entropy and probabilities appears difhcnlt to exploit for probability 
statements abont biological replication. The beanty of England’s paper [3] is that it 
sncceeds in making snch statements, based on time-reversal symmetry and some accessible 
estimates of reverse processes. The pnrpose of the present note has been to clean the 
theoretical basis of England’s argnments, nsing deterministic dynamics and a dehnition 
of metastable states based on eqnilibrinm statistical mechanics. We have proposed to 
replace (1) by (3) which holds also for qnantnm systems, bnt the biological applications 
and conclnsions remain those presented by J. England. 
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